Overview of QAST 2007
نویسندگان
چکیده
This paper describes QAST, a pilot track of CLEF 2007 aimed at evaluating the task of Question Answering in Speech Transcripts. The paper summarizes the evaluation framework, the systems that participated and the results achieved. These results have shown that question answering technology can be useful to deal with spontaneous speech transcripts, so for manually transcribed speech as for automatically recognized speech. The loss in accuracy from dealing with manual transcripts to dealing with automatic ones implies that there is room for future reseach in this area.
منابع مشابه
Question Answering on Speech Transcriptions: the QAST evaluation in CLEF
This paper reports on the QAST track of CLEF aiming to evaluate Question Answering on Speech Transcriptions. Accessing information in spoken documents provides additional challenges to those of text-based QA, needing to address the characteristics of spoken language, as well as errors in the case of automatic transcriptions of spontaneous speech. The framework and results of the pilot QAst eval...
متن کاملNamed Entity Recognition in Question Answering of Speech Data
Our contribution is centred on a study of Named Entity (NE) recognition on speech transcripts and how it impacts on the accuracy of the final question answering system. AnswerFinder was adapted to the task of question answering on speech transcripts and participated in the QAst pilot track of the CLEF competition. We have ported AFNER, the NE recogniser of AnswerFinder, to the set of answer typ...
متن کاملOverview of QAST 2008
This paper describes the experience of QAST 2008, the second time a pilot track of CLEF has been held aiming to evaluate the task of Question Answering in Speech Transcripts. Five sites submitted results for at least one of the five scenarios (lectures in English, meetings in English, broadcast news in French and European Parliament debates in English and Spanish). In order to assess the impact...
متن کاملDFKI-LT at QAST 2007: Adapting QA Components to Mine Answers in Speech Transcripts
The paper describes QAst-v1 a robust question answering system for answering factoid questions in manual and automatic transcriptions of speech. Our system is an adaptation of our text–based crosslingual open–domain QA system that we used for the Clef main tasks. In particular we assume that good answer candidates to factoid questions are named entities which are type–compatible with the expect...
متن کاملAnswerFinder at QAst 2007: Named Entity Recognition for QA on Speech Transcripts
Macquarie University’s contribution to the QAst track of CLEF is centered on a study of Named Entity (NE) recognition on speech transcripts, and how such NE recognition impacts on the accuracy of the final question answering system. We have ported AFNER, the NE recogniser of the AnswerFinder question-answering project, to the types of answer types expected in the QAst track. AFNER uses a combin...
متن کامل